Crack information editing device, method of editing crack information, and crack information editing program

ABSTRACT

A hierarchical structure information generation unit  112  corrects hierarchical structure information based on an editing instruction input by a user through an operation unit ( 120 ) (step S 160 : editing step). A display of the hierarchical structure information is updated based on the editing instruction input. The editing instruction input includes deleting a damage vector corresponding to a randomly selected label, combining a plurality of discontinuous damage vectors associated with a plurality of randomly selected labels into one continuous damage vector, releasing the combination between the plurality of the damage vectors, and selection of a label corresponding to a vector group, and deletion, combination, and release of the combination of the vector group corresponding to the selected label.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a Continuation of PCT InternationalApplication No. PCT/JP2017/000502 filed on Jan. 10, 2017 claimingpriority under 35 U.S.C § 119(a) to Japanese Patent Application No.2016-10709 filed on Jan. 22, 2016. Each of the above applications ishereby expressly incorporated by reference, in their entirety, into thepresent application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a crack information editing device, amethod of editing crack information, and a crack information editingprogram, and particularly to the crack information editing device, themethod of editing crack information, and the crack information editingprogram for editing crack information relating to a crack in astructure.

2. Description of the Related Art

Various kinds of damage are generated in structures such as a bridge, atunnel, a road, and a building, and the damage increases with time.Therefore, it is necessary to repair the damage according to a damagesituation in order to ensure safety of the structure. In the relatedart, the damage is inspected by a visual observation by a worker orusing an instrument. However, in recent years, electronic processing byan imaging device and/or an image processing device is employed due toproblems such as an inspection time, a cost, and an environment of aworkplace.

According to JP2011-242365A, a crack detection device selects a featureamount relating to a pixel value and calculates neural networkconvergence to generate a crack candidate image. In crack determinationon the candidate image, determination of the crack candidate image andconnection determination of a pixel existing within a near range of thecrack candidate image are performed. A determination is also made thatit is a distant region and not the crack based on a Euclidean distanceof an adjacent pixel.

The JP2002-174601A discloses labeling processing in which the same label(number) is assigned to a block of connected black pixels (or whitepixels) and different labels (numbers) are assigned to differentconnected components. Accordingly, it is possible to divide a regioninto a label of a damaged region such as the crack and a label of dirtand the like.

A labeling image subjected to the labeling processing is the image inwhich labels “A”, “B”, and “C” are assigned to a set of “1”, that is, ablock of “1”. In the image, it can be identified that the label “A” is alabel of a crack portion and the labels “B” and “C” are block portionsof the dirt and the like. A symbol is assigned as the label, but anumber may be assigned. Further, a label is assigned to a crack portionappeared on an image, the number of pixels of the crack portion ismeasured from the labeling image, and a width and a length of the crackare measured from the number of pixels and resolution.

SUMMARY OF THE INVENTION

A crack often has a discontinuous shape, and it is difficult todetermine intermittent lines as one crack.

At the point, there is a possibility that one crack is not appropriatelyconnected since the connection determination is performed using theEuclidean distance in JP2011-242365A. That is, even if cracks are apartfrom each other by the Euclidean distance, some cracks are recognized asone crack from a human eye, and there is a possibility that theconnection of the cracks with only the Euclidean distance as thereference is not compatible with crack connection in an actualoperation.

Therefore, it can be considered that a user performs an operation todesignate only a specific crack with respect to an automatic crackdetection result as in JP2011-242365A to edit the automatic crackdetection result. For example, there is a case where it is determined asan erroneous detection and one entire crack is deleted or the like.

However, since a shape of the crack generated in concrete becomescomplicated as the crack progresses, in a case where only a desiredcrack from dense cracks on the image is designated, pointing to anappropriate position is time-consuming work and an error is likely tooccur.

In a case where a position and a region of each crack is not known inadvance, it takes time to select the position and the region of eachcrack and an error is likely to occur due to the complexity of the shapeof each crack. In particular, since the crack has an intermittent shapeand the detection result is discontinuous according to the shape of thecrack, it is not easy to select the region. In a case where the cracksare densely distributed, difficulty of selecting the region is furtherincreased.

However, in the technique of JP2002-174601A, it is possible todistinguish a crack from dirt with labels, but it is impossible todesignate defect information such as a crack with the labels and todelete (edit and the like) the designated defect information.

The present invention is made in view of the above problems, and apurpose of the present invention is to easily designate and edit onecrack by appropriately labeling discontinuous cracks.

In order to solve the problems described above, a crack informationediting device according to a first aspect of the present inventionincludes a crack information acquisition unit that acquires crackinformation on a crack of a structure detected by an image analysis of asurface image of the structure, a labeling unit that assigns a label foridentifying crack information based on the crack information acquired bythe crack information acquisition unit, a display unit that displays avideo image indicating the crack information on the surface image in anoverlapped manner and displays a video image indicating the labelassigned by the labeling unit in association with the video imageindicating the crack information, a label selection unit capable ofaccepting selection of a predetermined label from among labels displayedby the display unit, and a crack information editing unit that acceptsediting of crack information associated with the label for which theselection by the label selection unit is accepted.

The crack information editing device according to the aspect can acceptthe editing of the crack information associated with the selected labelby label selection. Therefore, it is possible to easily select and editthe crack information by a user operation.

In the crack information editing device according to a second aspect ofthe present invention, the editing of the crack information accepted bythe crack information editing unit includes deleting the crackinformation, combining a plurality of pieces of discontinuous crackinformation associated with a plurality of randomly selected labels intoone continuous piece of crack information, or releasing the combinationbetween the plurality of pieces of discontinuous crack information.

It is possible to accept deletion, combination, and release of thecombination of the crack information associated with the selected labelby the label selection. Therefore, it is possible to easily edit thecrack information by a user operation.

In the crack information editing device according to a third aspect ofthe present invention, the labeling unit updates the label of the crackinformation acquired by the crack information acquisition unit accordingto the editing of the crack information, and the display unit updatesthe video image indicating the crack information and the video imageindicating the label according to the editing of the crack information.

Accordingly, it is possible to visually and easily confirm an editingresult of the crack information relating to the selected label.

In the crack information editing device according to a fourth aspect ofthe present invention, in a case where deletion of the crack informationis accepted by the crack information editing unit, the labeling unitdeletes the selected label, and the display unit stops a display of avideo image indicating crack information corresponding to the selectedlabel.

Accordingly, it is possible to visually and easily confirm a deletionresult of the crack information relating to the selected label.

In the crack information editing device according to a fifth aspect ofthe present invention, in a case where a combination between theplurality of pieces of crack information is accepted by the crackinformation editing unit, the labeling unit assigns a common label tothe plurality of pieces of crack information for which the combinationis accepted, and the display unit displays a video image indicating thecommon label in association with a video image indicating the combinedplurality of pieces of crack information.

Accordingly, it is possible to visually and easily confirm a combinationresult of the crack information relating to the selected label.

In the crack information editing device according to a sixth aspect ofthe present invention, in a case where release of the combinationbetween the plurality of pieces of crack information is accepted by thecrack information editing unit, the labeling unit assigns a labelcapable of distinguishing between the plurality of pieces of crackinformation for which the release of the combination is accepted to eachof the plurality of pieces of crack information, and the display unitdisplays each of the distinguishable labels in association with a videoimage indicating each of the plurality of pieces of crack information.

Accordingly, it is possible to visually and easily confirm a releaseresult of the combination of the crack information relating to theselected label.

In the crack information editing device according to a seventh aspect ofthe present invention, the display unit displays a video imageindicating the label assigned by the labeling unit at a position outsidethe video image indicating the crack information.

Accordingly, visibility is improved without interference of the videoimage of the crack information with the video image of the label.

In the crack information editing device according to an eighth aspect ofthe present invention, the video image indicating the label is a balloonindividually including a label for each of the crack informationacquired by the crack information acquisition unit or a list tableincluding a plurality of labels of the crack information acquired by thecrack information acquisition unit.

Since a predetermined label can be selected from the balloon includingthe crack information or the list table including the plurality oflabels of the crack information, it is easy to select the label.

In the crack information editing device according to a ninth aspect ofthe present invention, the display unit highlights the video image ofthe crack information associated with the selected label.

Accordingly, it is easy to identify the crack information relating tothe selected label.

In the crack information editing device according to a tenth aspect ofthe present invention, the crack information acquisition unit acquiresthe crack information on the crack of the structure by Kruskal'salgorithm, Prim's algorithm, neural network convergence calculation,percolation method, or the like.

In the crack information editing device according to an eleventh aspectof the present invention, the crack information is vector data includinga width, a length, and a direction of a crack.

A method of editing crack information according to a twelfth aspect ofthe present invention, a computer executes a step of acquiring crackinformation on a crack of a structure detected by an image analysis of asurface image of the structure, a step of assigning a label foridentifying crack information based on the acquired crack information, astep of displaying a video image indicating the crack information on thesurface image in an overlapped manner and displaying a video imageindicating the assigned label in association with the video imageindicating the crack information, a step of accepting selection of apredetermined label from among the displayed labels, and a step ofaccepting editing of crack information associated with the label forwhich the selection is accepted.

A crack information editing program for causing a computer to executethe method of editing crack information described above is also includedin an aspect of the present invention.

According to the present invention, it is possible to accept the editingof the crack information associated with the selected label by the labelselection. Therefore, it is possible to easily select and edit the crackinformation by a user operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating a bridge which is an example of astructure.

FIG. 2 is a block diagram illustrating a configuration of a damageinformation processing device according to one embodiment of the presentinvention.

FIG. 3 is a flowchart illustrating a procedure of a method of processingdamage information according to one embodiment of the present invention.

FIG. 4 is a diagram illustrating a manner of dividing a curved damage togenerate a plurality of damage vectors.

FIG. 5 is a diagram for describing a manner of determining start pointsof damage vectors.

FIG. 6 is another diagram for describing a manner of determining a startpoint of the damage vector.

FIG. 7 is a diagram illustrating a connection of separated damagevectors.

FIG. 8 is another diagram illustrating the connection of the separateddamage vectors.

FIG. 9 is a table indicating image information included in hierarchicalstructure information.

FIG. 10 is a diagram illustrating an example of damage vectorinformation (corresponding to example 1 of method of determininghierarchy) included in the hierarchical structure information.

FIG. 11A is a diagram for describing a display example of the damagevectors and labels.

FIG. 11B is a diagram for describing a display example of the damagevectors and the labels.

FIG. 12 is another diagram for describing example 2 of the method ofdetermining hierarchy of the damage vectors.

FIG. 13 is a table indicating an example of hierarchical structureinformation (damage vector information) corresponding to example 2 ofthe method of determining hierarchy.

FIG. 14 is a diagram for describing example 3 of the method ofdetermining hierarchy of the damage vector.

FIG. 15 is another diagram for describing example 3 of the method ofdetermining hierarchy of the damage vectors and is a diagramillustrating an image captured later in time than in FIG. 14.

FIG. 16 is still another diagram for describing example 3 of the methodof determining hierarchy of the damage vectors and is a diagramillustrating an image captured later in time than in FIG. 15.

FIG. 17 is a table indicating an example of hierarchical structureinformation (damage vector information) corresponding to example 3 ofthe method of determining hierarchy.

FIG. 18 is a diagram for describing example 4 of the method ofdetermining hierarchy of damage vectors.

FIG. 19 is a table indicating an example of hierarchical structureinformation (damage vector information) corresponding to example 4 ofthe method of determining hierarchy.

FIG. 20 is a diagram illustrating a manner in which a label of C1-3 isselected and a delete instruction input is performed to a damage vectorcorresponding to the label.

FIG. 21 is a diagram illustrating an updated display example in which adisplay of the label of C1-3 is deleted and a display of the damagevector corresponding to the label of C1-3 is deleted as a result ofperforming the delete instruction input to the damage vectorcorresponding to the label of C1-3.

FIG. 22 is a diagram illustrating an example of the hierarchicalstructure information in which “1” is assigned to a delete operationflag of the damage vector corresponding to the label of C1-3 as theresult of performing the delete instruction input.

FIG. 23 is a diagram illustrating a manner in which labels of C1-5 andC8-1 are selected and a combination instruction input between damagevectors corresponding to the labels is performed.

FIG. 24 is a diagram illustrating an updated display example of a linesegment of a damage vector that combines the damage vectorscorresponding to the labels of C1-5 and C8-1, and a label of “C1-5+C8-1”assigned to the added damage vector as a result of performing thecombination instruction input.

FIG. 25 is a diagram illustrating an updated example of the hierarchicalstructure information in which “2” is assigned to an add operation flagof the damage vectors corresponding to the labels of C1-5 and C8-1.

FIG. 26 is a diagram illustrating a manner in which the label of“C1-5+C8-1” corresponding to the added damage vector is selected and acombination release instruction input between the damage vectorscorresponding to the labels is performed.

FIG. 27 is a diagram illustrating a display example in which thecombination between the damage vectors of the labels of C1-5 and C8-1 isreleased as a result of performing the combination release instructioninput.

FIG. 28 is a diagram illustrating an example of the hierarchicalstructure information in which “0” is assigned to the add operation flagof the damage vectors corresponding to the labels of C1-5 and C8-1.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of a crack information editing device, a methodof editing crack information, and a crack information editing programaccording to the present invention will be described with reference toaccompanying drawings.

First Embodiment

FIG. 1 is a perspective view illustrating a structure of a bridge 1(structure and concrete structure) which is an example of the structurein which the crack information editing device, the method of editingcrack information, and the crack information editing program accordingto the present invention are employed. The bridge 1 illustrated in FIG.1 has a main girder 3, and the main girders 3 are joined by joiningparts 3A. The main girder 3 is bridged between an abutment and/or abridge pier and is a member for supporting a load of a vehicle and thelike on a floor slab 2. The floor slab 2 for the vehicle and the like torun is installed on the upper part of the main girder 3. It is assumedthat the floor slab 2 is made of reinforced concrete. The bridge 1 hasmembers such as a cross girder, a cross frame, and a lateral frame (notillustrated) in addition to the floor slab 2 and the main girder 3.

<Image Acquisition>

In a case where damage of the bridge 1 is inspected, an inspector imagesthe bridge 1 from the lower side (C direction of FIG. 1) using a digitalcamera 104 (refer to FIG. 2) and acquires a surface image of aninspection range. The imaging is performed while appropriately moving inan extending direction (A direction of FIG. 1) of the bridge 1 and anorthogonal direction (B direction of FIG. 1) of the extending direction.In a case where it is difficult for the inspector to move due to asurrounding condition of the bridge 1, the imaging may be performed byinstalling the digital camera 104 in a moving object that can move alongthe bridge 1. A lifting mechanism and/or a pan and tilt mechanism of thedigital camera 104 may be provided in such moving object. An example ofthe moving object includes a vehicle, a robot, or a flying object, butis not limited thereto.

<Configuration of Damage Information Processing Device>

FIG. 2 is a block diagram illustrating a schematic configuration of adamage information processing device 100 which is the embodimentaccording to the crack information editing device of the presentinvention. The damage information processing device 100 includes adamage information acquisition unit 102 (corresponding to crackinformation acquisition unit), a damage vector generation unit 110(corresponding to labeling unit), a hierarchical structure informationgeneration unit 112, a damage vector extraction unit 114, a hierarchicalstructure information recording unit 116 (corresponding to crackinformation editing unit), a display unit 118 (corresponding to displayunit), and an operation unit 120 (corresponding to label selectionunit). The above units are connected to each other and can transmit andreceive necessary information to each other.

A function of each unit can be realized, for example, by causing acontrol device such as a central processing unit (CPU) to execute aprogram stored in a memory. The damage information acquisition unit 102includes a wireless communication antenna and an input or outputinterface circuit, and the hierarchical structure information recordingunit 116 is composed to include a non-transitory recording medium suchas a hard disk drive (HDD). The display unit 118 includes a displaydevice such as a liquid crystal display, and the operation unit 120includes an input device such as a keyboard. The above configurationindicates an example of the configuration of the damage informationprocessing device according to the present invention, and anotherconfiguration may be employed as appropriate.

The image captured using the digital camera 104 as described above isinput to an image acquisition unit 106 by wireless communication, anddamage information is acquired by an image processing unit 108. Thedigital camera 104, the image acquisition unit 106, and the imageprocessing unit 108 compose the damage information acquisition unit 102.The damage vector generation unit 110 generates a damage vector (crackvector) by performing an image analysis from the damage informationacquired by the damage information acquisition unit 102 and connectsspatially separated damage vectors. The hierarchical structureinformation generation unit 112 generates hierarchical structureinformation based on the damage vector generated by the damage vectorgeneration unit 110, and the generated hierarchical structureinformation is recorded in the hierarchical structure informationrecording unit 116. The damage vector extraction unit 114 extracts adamage vector that satisfies a designated condition such as a hierarchyto which the damage vector belongs with reference to the hierarchicalstructure information. The display unit 118 displays all or a part ofthe input image, the generated or extracted damage vector, thehierarchical structure information, and the like in an overlapped manneror alone. The display unit 118 performs image processing necessary fordisplay such as generating an image of a line segment from informationof the damage vector. The operation unit 120 accepts instruction inputsby a user relating to extraction conditions of the damage vector and thehierarchical structure information, a setting of a display condition,editing of the hierarchical structure information, and the like.

<Procedure of Damage Information Processing>

Next, damage information processing (corresponding to the method ofediting crack information of the present invention) using a damageinformation processing device 100 having the configuration describedabove will be described. FIG. 3 is a flowchart illustrating a procedureof the damage information processing according to the embodiment. In theembodiment, a case where the damage is the crack generated in the floorslab 2 is described, and the damage is described as “crack” asappropriate. However, the damage in which the present invention can beemployed is not limited to the crack but may be another piece of damagesuch as free lime. A program (corresponding to the crack informationediting program of the present invention) for causing the damageinformation processing device 100 to execute the processing is recordedin a computer-readable non-transitory tangible medium such as a flashmemory built in the damage information processing device 100.

<Damage Information Acquisition Step>

First, the image of the bridge 1 captured by the digital camera 104 asdescribed above is input to the image acquisition unit 106 by thewireless communication (step S100; image input step). A plurality ofimages of the bridge 1 are input according to the inspection range, andinformation of imaging date and time is added to the input images by thedigital camera 104. The imaging date and time of the input images arenot necessarily the same in all the images and may be over several days.The plurality of images may be collectively input or one image may beinput at a time. The image of the bridge 1 may be input through thenon-transitory recording mediums such as various memory cards instead ofthe wireless communication or data of an image already captured andrecorded may be input via a network. The image of the bridge 1 input instep S100 may be the captured image as it is or may be an image obtainedby subjecting the captured image to pre-processing.

<Damage Extraction Step>

Next, the image processing unit 108 extracts the damage (crack) from theinput image (step S110; the damage extraction step). The image inputstep of step S100 and the damage extraction step of a step S110 composethe damage information acquisition step in the method of processingdamage information of the present invention. In step S110, in a casewhere damage is extracted from the image input in step S100, that is, adamaged region in the image is identified, it may be considered that thedamage information is acquired and there is no need to grasp a detailedfeature of the damage.

The damage extraction in step S110 can be performed by various methods,and a method of detecting the crack disclosed, for example, inJP4006007B can be used. The method is the method of detecting the crackconsisted of a step of creating a wavelet image by calculating waveletcoefficient corresponding to two concentrations to be compared andcalculating each wavelet coefficient in a case where the twoconcentrations are respectively changed to create a wavelet coefficienttable, and performing wavelet conversion of the input image obtained byimaging a concrete surface which is a crack detection target, and a stepof determining a crack region and a non-crack region by comparing awavelet coefficient of an interest pixel with a threshold value withwavelet coefficient, corresponding to an average concentration of nearpixels and a concentration of the interest pixel within a local region,as the threshold value in the wavelet coefficient table.

The damage extraction in step S110 may be performed after subjecting theimage input in step S100 to the necessary pre-processing.

<Generation of Damage Vector>

In a case where the damage is extracted in step S110 (damage informationis acquired), the damage vector generation unit 110 vectorizes theacquired damage information to generate the damage vector (crack vector)(step S120; damage vector generation step). In the case ofvectorization, the extracted damage (crack) is binarized and/or thinnedas necessary. The “vectorization” refers to obtain a line segmentdetermined by a start point and an end point for the damage. In a casewhere the damage (crack) is curved, the damage is divided into aplurality of sections such that a distance between a curved line and aline segment is equal to or less than a threshold value, and a damagevector is generated for each of the plurality of sections. In an exampleof FIG. 4, a curved damage Cr is divided into four sections Cr1 to Cr4and damage vectors Cv1 to Cv4 are generated for respective sections suchthat distances dl to d4 between pieces of damage in the sections Cr1 toCr4 and the damage vectors Cv1 to Cv4 is equal to or less than thethreshold value.

In the case of generating the damage vector, for example, it is possibleto set an termination point where a distance from the origin is minimumas a first start point and to sequentially determine the end point andthe start point along a running direction of the damage vector for agroup of the damage vectors (vector group) using a feature point of thefloor slab 2 as the origin of a coordinate system. In an example of FIG.5, in a case where a point P0 on the floor slab 2 is set as the originof the coordinate system and the right direction and the downwarddirection of the figure are respectively set as the X-axis direction andthe Y-axis direction of the coordinate system, it is possible to set apoint P13 where a distance d from the point P0 is the shortest amongpoints P13, P14, P15, and P16 of a vector group C7 as the start point ofa damage vector C7-1, the point P14 as the end point of the damagevector C7-1 (and start point of damage vectors C7-2 and C7-3), and thepoints P15 and P16 as the end points of respective damage vectors C7-2and C7-3.

However, in a case where the start points of a vector group C8 aredetermined by the same method, since a point P17 becomes the start pointof a damage vector C8-1 and a point P18 becomes the start point ofdamage vectors C8-2 and C8-3, a running direction of the damage vectorC8-3 (direction from point P18 to point P20) is opposite to a runningdirection of the damage vector C8-1. In such case, as illustrated inFIG. 6, a point P19 may be set as the start point of a damage vectorC8A-1, the point P18 may be the end point of the damage vector C8A-1(and start points of damage vectors C8A-2 and C8A-3), and the points P17and P20 may be respectively set as the end points of the damage vectorsC8A-2 and C8A-3. In the case, a set of the damage vectors is expressedas a vector group C8A. Such processing may be performed by the damagevector generation unit 110 without the instruction input by the user ormay be performed by the damage vector generation unit 110 based on theinstruction input by the user through the operation unit 120.

<Connection of Separated Damage Vectors>

In the case of generating the damage vector as described above, there isa possibility that the damage is recognized as separated damage vectorsin a case where the damage is continuous inside the floor slab 2 but isseparated on the surface thereof. In the damage information processingdevice 100 according to the embodiment, such plurality of damage vectorsare connected to generate one vector or a plurality of vectors.

FIG. 7 is a diagram illustrating an example of the connection of damagevectors and illustrates a situation that a vector group C3 including adamage vector C3-1 (points P21 and P22 are respectively the start pointand the end point) and a vector group C4 including a damage vector C4-1(points P23 and P24 are respectively the start point and the end point)are extracted. An angle formed by the damage vector C3-1 with a linesegment connecting the point P22 and the point P23 is set as α1, and anangle formed by the line segment connecting the point P22 and the pointP23 with the damage vector C4-1 and is set as α2. At the time, in a casewhere both the angle α1 and the angle α2 are equal to or less than athreshold value, the damage vectors C3-1 and C4-1 are connected, and thevector groups C3 and C4 are merged. Specifically, a new damage vectorC5-2 is generated to connect other damage vectors C5-1 (same as damagevector C3-1) and C5-3 (same as damage vector C4-1) as illustrated inFIG. 8, and a new vector group including the damage vectors C5-1, C5-2,and C5-3 is set as a vector group C5.

The above method is an example of a method of connecting the damagevectors, and another method may be used. Whether to connect the damagevectors as described above may be determined by the damage vectorgeneration unit 110 or by the damage vector generation unit 110 based onthe instruction input by the user through the operation unit 120regardless of the instruction input by the user.

In this manner, in the damage information processing device 100according to the embodiment, it is possible to accurately grasp aconnection relationship between the damage vectors by appropriatelyconnecting the damage vectors separated (on the surface of floor slab 2)spatially.

<Generation of Hierarchical Structure Information>

In the case where the damage vector is generated in step S120, thehierarchical structure information generation unit 112 generates thehierarchical structure information based on the generated damage vector(step S130; hierarchical structure information generation step). Thehierarchical structure information is information in which theconnection relationship between the damage vectors is representedhierarchically and is composed of image information (refer to FIG. 9)and damage vector information (refer to FIGS. 10, 13, 17, and 19). Theimage information and the damage vector information are associated witheach other through the vector group which is a set of the damage vectors(crack vectors). Therefore, it is possible to extract the damage vectorwith reference to identification (ID) of the vector group from the imageof the damage and conversely to extract the image based on the damagevector. Since the hierarchical structure information is generated in thesame item and format regardless of a hierarchy (level) to which thedamage vector belongs (refer to FIGS. 10, 13, 17, and 19), the user caneasily recognize and grasp the hierarchical structure information.

<Image Information>

The image information described above is information on the capturedimage in which the damage is imaged and defines identificationinformation (ID) and image data of the captured image, image acquisitiondate and time, and the like for the group of the damage vectors. FIG. 9is a table indicating an example of the image information, and an ID ofan image, image data, acquisition date and time, width and height of theimage, the number of channels, bit/pixel, and resolution are defined fora vector group C1 (refer to FIG. 11A). The number of channels is threechannels for an RGB (R: red, G: green, B: blue) color image and is onechannel for a monochrome image. Only the vector group C1 is described inFIG. 9. However, in a case where a plurality of vector groups exist, thesame information is generated for each group.

<Damage Vector Information>

FIG. 10 is an example of the damage vector information. The damagevector information is composed of information of the vector group towhich the damage vector belongs, specific information of each damagevector, information of another damage vector connected to each damagevector in the vector group, and additional information.

The information of the vector group (refer to vector group C1 in a caseof the table of FIG. 10; FIG. 11A) includes a label (identificationinformation) of the group. The specific information of the damage vectorincludes label (identification information) of the damage vector,hierarchy (level; belonging hierarchy information), start point and endpoint (point number and position coordinate), and length. Here, in thehierarchy (level), level 1 is the highest hierarchy, and the hierarchybecomes lower as the number increases. Specifically, a method ofdetermining hierarchy will be described below in detail. Other pieces ofinformation of the damage vector include labels (identificationinformation) of a parent vector, a sibling vector, and a child vector asdescribed below. The additional information includes the width ofdamage, delete operation flag, add operation flag, inspection date, andrepair information.

<Parent Vector, Sibling Vector, and Child Vector>

In the embodiment, in a case where the end point of one damage vector isthe start point of another damage vector, the formal damage vector isreferred to as “parent vector” and the latter damage vector is referredto as “child vector”. The parent vector is determined so as to be zeroor one for one damage vector, but the child vector may exist by apredetermined number of zero or more for one parent vector. In a casewhere the end point of the parent vector is the start point of aplurality of child vectors, the plurality of child vectors are referredto as “sibling vectors” from each other. The sibling vector may alsoexist by a predetermined number of zero or more.

In this manner, in the embodiment, since the hierarchical structureinformation includes the labels (identification information) of theparent vector, the sibling vector, and the child vector, it is possibleto sequentially specify a parent vector, a sibling vector, and a childvector with reference to vector ID based on a predetermined damagevector. For example, it is possible to specify a parent vector of acertain damage vector and to further specify a parent vector of theparent vector. In this manner, in the damage information processingdevice 100 according to the embodiment, it is possible to easily graspthe connection relationship between the damage vectors and to easilyanalyze and search the damage vector.

<Additional Information>

The “width” included in the additional information indicates a width ofthe crack corresponding to each damage vector. The delete operation flagindicates whether a delete operation is performed on the vector. Thedelete operation flag is “1” in a case where the delete operation isperformed and “0” in a case where the delete operation is not performed.It is possible to switch between display and non-display of the damagevector with reference to the delete operation flag. The add operationflag is related to a detection form of the damage vector. The addoperation flag is “0” in a case of a vector detected automatically, “1”in a case of a vector added manually (by the instruction input by theuser), and “2” in a case of a vector generated by connecting vectors ofdifferent labels added manually.

A date on which the image of damage is captured is set on “inspectiondate”, but the date can be edited by the instruction input by the userthrough the operation unit 120. The information of “repair” can begenerated based on the instruction input (repair type and repair date)by the user through the operation unit 120. The repair type is, forexample, filling with cement, filling with resin, leaving (follow-upobservation), or the like (respectively described as R1, R2, and R3 inthe table of FIG. 10).

<Hierarchy of Damage Vector>

Next, the hierarchy (level) to which the damage vector belongs will bedescribed. The hierarchy of the damage vector can be determined byvarious methods, for example, as described in the following examples 1to 4.

Method of Determining Hierarchy (Example 1)

FIG. 11A is a diagram illustrating the vector group C1. The vector groupC1 is composed of damage vectors C1-1 to C1-6, and the damage vectorshave points P1 to P7 as the start points or the end points. In suchsituation, in example 1, it is assumed that the hierarchy becomes lowerevery time the damage vector diverges (end point of a certain damagevector becomes start point of a plurality of other damage vectors).Specifically, it is assumed that the hierarchy of the damage vector C1-1is “level 1” which is the highest level, and the hierarchy of the damagevectors C1-2 and C1-3 having the point P2 which is the end point of thedamage vector C1-1 as the start point is “level 2”, which is a levellower than the damage vector C1-1. Similarly, it is assumed that thehierarchy of the damage vectors C1-5 and C1-6 having the point P4 whichis the end point of the damage vector C1-3 as the start point is “level3”, which is a level lower than the damage vector C1-3. On the otherhand, the point P3 which is the end point of the damage vector C1-2 isthe start point of the damage vector C1-4. However, since the damagevector having the point P3 as the start point is only the damage vectorC1-4 and does not diverge, it is assumed that the hierarchy of thedamage vector C1-4 is “level 2” which is the same as the C1-2. Thehierarchy of each damage vector determined in this manner is included inthe hierarchical structure information as indicated in the table of FIG.10.

As illustrated in FIG. 11A, an individual label of each damage vector isdisplayed on the display unit 118 in association with each damage vectorby a balloon video image starting from the start point, the end point,or a predetermined position near the line segment connecting the startpoint and the end point of each corresponding damage vector. The labelof each damage vector may be displayed in association with each damagevector by a video image such as a flag, a plate, a box, a line, a table,or the like or a combination of all or a part of the video imagesstarting from a predetermined position near the line segment of eachcorresponding damage vector. The balloon may be disposed outside thevideo image of the damage vector and positioned to avoid overlap withthe damage vector itself.

A display position and a display format of the label are predetermined.In FIG. 11A, the labels are disposed near the damage vectors. However,as illustrated in FIG. 11B, a label group including a plurality oflabels may be displayed in a list table on a blank portion of a screenwhich does not overlap the damage vector, and correspondence betweeneach label and each damage vector may be indicated by associating eachlabel with each damage vector with a line connecting each label and eachdamage vector on a one-to-one basis. The individual label indicated bythe balloon or the like or the list table of the labels may not bedisplayed in an overlapped manner with the damage vector of the samegroup and may be displayed in an overlapped manner with the damagevector corresponding to a different group.

Method of Determining Hierarchy (Example 2)

FIG. 12 is a diagram illustrating the vector group C1 (connectionrelationship between damage vectors is the same as the connectionrelationship illustrated in FIG. 11A). In example 2, it is assumed thata damage vector (damage vector corresponding to a “trunk” in a treestructure) having an angle with another damage vector is equal to orless than a threshold value among the damage vectors to be connectedbelongs to the same hierarchy. Specifically, it is assumed that thedamage vectors C1-1, C1-2, and C1-4 existing in a dotted line (rangeindicated by reference symbol Lv1) of FIG. 12 are “level 1” (the highestlevel) which is the same hierarchy. For the damage vectors C1-3, C1-5,and C1-6 other than the damage vectors C1-1, C1-2, and C1-4, similar toexample 1, it is assumed that the hierarchy becomes lower every time thedamage vector diverges, the damage vector C1-3 (corresponding to a“branch” in the tree structure) is “level 2”, and the damage vectorsC1-5 and C1-6 (corresponding to a “leaf” in the tree structure) are“level 3”. The hierarchy and the type (trunk, branch, or leaf) of eachdamage vector determined in this manner are included in the hierarchicalstructure information as illustrated in a table of FIG. 13.

Method of Determining Hierarchy (Modification Example of Example 2)

A modification example of the method of determining hierarchy (example2) described above will be described. In a case of determininghierarchies of the damage vectors corresponding to the trunk, thebranch, and the leaf in the tree structure as the method of determininghierarchy (example 2), since the “branch” is commonly considered to beshorter than the “trunk”, the hierarchy may be determined with thelongest damage vector as “trunk” (level 1) and with another damagevector as the “branch” or the “leaf”. In the case, for example, in thedamage vector information illustrated in the table of FIG. 13, thedamage vector C1-1 having the length of 100 mm becomes the “trunk”(level 1). It is possible to set the damage vectors C1-2 and C1-3 as the“branches” (level 2), set the damage vector C1-4 as the “branch” (level2) or the “leaf” (level 3), and set each of the damage vectors C1-5 andC1-6 as “leaf” (level 3).

A damage vector composing “the longest crack” instead of “the longestdamage vector” may be set as the “trunk” (level 1), and a damage vectorcorresponding to a crack diverging from the “trunk” may be set as the“branch” or the “leaf”. In the case, it is assumed that “the longestcrack” means that “it is the longest as the crack in a state where athick crack and a thin crack are all connected”.

The type (trunk, branch, and leaf) and the hierarchy may be determinedin consideration of the width (width of damage corresponding to damagevector) in addition to the length of the damage vector. For example, thehierarchy may be determined with a damage vector in which “length×width”is the maximum as the “trunk” and with another damage vector as the“branch” or the “leaf”. In the case, for example, in the damage vectorinformation illustrated in the table of FIG. 13, the damage vector C1-1in which “length×width” is maximum (100 mm²) becomes the “trunk”. It ispossible to set the damage vectors C1-2 and C1-3 as the “branches”(level 2), set the damage vector C1-4 as the “branch” (level 2) or the“leaf” (level 3), and set each of the damage vectors C1-5 and C1-6 asthe “leaf” (level 3).

As the modification example described above, it is possible to improvethe accuracy of hierarchization by determining hierarchy of the damagevector in consideration of the length or “length×width” of the damagevector.

Method of Determining Hierarchy (Example 3)

FIGS. 14 to 16 are diagrams illustrating the vector group C1 (connectionrelationship between damage vectors is the same as the connectionrelationship illustrated in FIGS. 11A and 12). In example 3, an order oftime when the damage vectors are generated is determined based onimaging date and time of the image of the bridge 1, and it is assumedthat a damage vector generated later in time belongs to a lowerhierarchy. In the cases of FIGS. 14 to 16, it is assumed that a vectorgroup CIA including the damage vector C1-1 is generated in a firstcaptured image (FIG. 14), the damage vectors C1-2 and C1-3 are newlygenerated to become a vector group C1B (FIG. 15) in a next capturedimage, and the damage vectors C1-4, C1-5, and C1-6 are further generatedto become the vector group C1 in a finally captured image (FIG. 16).

In such situation, in example 3, it is assumed that the damage vectorC1-1 (range indicated by reference symbol Lv1 in FIG. 14) generated inthe first image is “level 1” of the highest level, the damage vectorsC1-2 and C1-3 (range indicated by reference symbol Lv2 in FIG. 15)generated in the next image are “level 2”, and the damage vectors C1-4,C1-5, and C1-6 (ranges indicated by reference symbols Lv3 in FIG. 16)generated in the final image are “level 3”.

The hierarchy of each damage vector determined in this manner isincluded in the hierarchical structure information as described in atable of FIG. 17.

Method of Determining Hierarchy (Example 4)

FIG. 18 is a diagram illustrating a crack C2A and a vector group C2corresponding to the crack C2A. In example 4, in a case where anotherdamage vector connected to one damage vector is only one, it is assumedthat another damage vector belongs to the same hierarchy as one damagevector. Specifically, as illustrated in FIG. 18, in a case where onecurved crack C2A is divided into a plurality of cracks C2A-1 to C2A-4,and the cracks respectively correspond to damage vectors C2-1 to C2-4with points P8 to P12 as the start points or the end points, only onedamage vector (damage vectors C2-2 to C2-4) is respectively connected tothe end points of the damage vectors C2-1 to C2-3. In such case, inexample 4, it is assumed that the damage vectors C2-1 to C2-4 (rangeindicated by reference symbol Lv1 in FIG. 18) are substantiallyconsidered as one and belong to “level 1” (the highest level) which isthe same hierarchy.

The hierarchy of each damage vector determined in this manner isincluded in the hierarchical structure information as described in atable of FIG. 19.

The examples 1 to 4 of the methods of determining hierarchy to which thedamage vector belongs are described. The methods can be used asappropriate according to a specific damage form and may be used bycombining a plurality of the methods as necessary. For a group of damagevectors having a complicated connection pattern, for example, ahierarchy of a certain portion may be determined using example 1, and ahierarchy of another portion may be determined using example 4. Suchcombination of the hierarchy methods may be determined by thehierarchical structure information generation unit 112 or may beperformed based on the instruction input by the user through theoperation unit 120.

<Item and Format of Hierarchical Structure Information>

In the embodiment, as illustrated in the tables in FIGS. 10, 13, 17, and19, since the hierarchical structure information has the same item andformat regardless of the hierarchy to which the damage vector belongs,it is possible to quickly and easily grasp the connection relationshipbetween the damage vectors.

<Extraction of Damage Vector>

Next, extraction of the damage vector will be described. In theembodiment, since the vector group to which the damage vector belongs,the label of the damage vector, the belonging hierarchy, the label ofanother damage vector (parent vector, the sibling vector, and the childvector) to be connected, and the like are included in the hierarchicalstructure information (refer to FIGS. 10, 13, 17, and 19), it ispossible to designate a desired condition for the items and extract thedamage vector. The designated condition includes, for example,“hierarchy to which the damage vector belongs” and “vector in which aspecific vector is the parent vector, the sibling vector, or the childvector”, but a condition that can be designated is not limited to aboveexamples.

For example, in a case of the damage vector information illustrated inFIG. 10, the damage vectors C1-2, C1-3, and C1-4 are extracted withreference to a field of “hierarchy (level)” of the hierarchicalstructure information in a case of designating “hierarchy (level) of thedamage vector is level 2” as the condition, and the damage vector C1-1(parent vector) is extracted in a case of designating “damage vectorwhich is connected to damage vector C1-2 and belongs to a hierarchyhigher than the damage vector C1-2” as the condition. The damage vectorsC1-3 (sibling vector) and C1-4 (child vector) are extracted in a case ofdesignating “damage vector which is connected to damage vector C1-2 andbelongs to the same hierarchy as the damage vector C1-2” as thecondition, and the damage vectors C1-5 and C1-6 (child vector) areextracted in a case of designating “damage vector which is connected todamage vector C1-3 and belongs to a hierarchy lower than the damagevector C1-3” as the condition. In this manner, the extraction of thedamage vector can be performed by the damage vector extraction unit 114with reference to the hierarchical structure information recording unit116 based on the instruction input by the user through the operationunit 120.

In this manner, in the damage information processing device 100according to the embodiment, it is possible to easily search, analyze,and evaluate the damage vector. The extracted damage vector can bedisplayed in a format of individual information and/or line drawing(described below).

<Display of Damage Vector and Hierarchical Structure Information>

In a step S140, the hierarchical structure information generated in stepS130 is displayed in the display unit 118 (display step). The display ofthe hierarchical structure information can be performed, for example, inthe format of tables as indicated in FIGS. 9, 10, 13, 17, and 19 or by apart of information extracted from the tables. An example of such “apart of information” can include “information of damage vector extractedunder designated condition” and “information on specific items such asinspection date and/or repair date”.

The line drawing indicating the damage vector may be drawn based on thehierarchical structure information and displayed in the display unit118. As indicated in the tables of FIGS. 10, 13, 17, and 19, sinceinformation on the start point and the end point of the damage vectorand another damage vector to be connected is included in thehierarchical structure information, the line drawing (for example, referto FIGS. 11A, 11B, 12, and 14 to 16) indicating the damage vector can bedrawn and displayed based on the pieces of information. An arrow may beattached to the line drawing indicating the damage vector so as toidentify a direction (direction from start point to end point) of thedamage vector (refer to FIGS. 11A, 11B, 12, and 14 to 16). In a casewhere the line drawing of the damage vector is drawn and displayed, alldamage vectors included in the hierarchical structure information may bedrawn and displayed or only a part of the damage vector (for example,extracted under the designated condition as described above) may bedisplayed.

In a case of displaying a line drawing indicating the damage vector, avideo image of a corresponding label may be disposed near the linedrawing or display conditions such as color, thickness, and line type(solid line, dotted line, or the like) of the damage vector may bechanged according to specific information among information included inthe hierarchical structure information. Such information can include,for example, hierarchy (level) of the damage vector, type (trunk,branch, or leaf), generation date and time, values of the deleteoperation flag and the add operation flag, and the like, and may be setas appropriate from among the items included in the hierarchicalstructure information. It is possible to easily grasp the connectionrelationship between the damage vectors and/or a manner of time changeby displaying the line drawing in a form according to the feature of thedamage vector in this manner.

Any one of the line drawing and the hierarchical structure informationof the damage vector described above may be displayed or both the linedrawing and the hierarchical structure information thereof may bedisplayed simultaneously. In the display described above, an image (forexample, image “img_2015-001” indicated in table of FIG. 9) in which thedamage (crack) is imaged may be displayed in an overlapped(superimposed) manner or side-by-side with a line drawing of the damagevector so as to compare both the image and the line drawing (forexample, refer to FIG. 18).

In the embodiment, since the damage vector and/or the hierarchicalstructure information are displayed in this manner, it is possible toeasily grasp the information of the damage vector and the connectionrelationship between the damage vectors.

<Recording of Damage Vector and Hierarchical Structure Information>

In a step S150, the hierarchical structure information is recorded inthe hierarchical structure information recording unit 116 (recordingstep). The hierarchical structure information recorded in thehierarchical structure information recording unit 116 can be used foranalysis, evaluation, and the like of the damage. In a case where a partof information (for example, damage vector satisfying designatedcondition) is extracted from the hierarchical structure information,since all the extracted information in this manner is included in theoriginal hierarchical structure information, an extracted result may notbe necessarily recorded. However, it is possible to quickly refer theextracted result as necessary by recording the extracted result in thehierarchical structure information recording unit 116.

<Editing of Damage Vector and Hierarchical Structure Information>

In a step S160, the hierarchical structure information generation unit112 corrects the hierarchical structure information recorded in thehierarchical structure information recording unit 116 based on anediting instruction input by the user through the operation unit 120(editing step). The display of the damage vector and the label isupdated by the display unit 118 based on the editing instruction input.

The editing instruction input includes the followings.

(1) Deleting a damage vector corresponding to a randomly selected label.In a case where the editing instruction input is performed, “1” isassigned to the delete operation flag of a deleted damage vector.

A delete instruction input of the damage vector can be performed asfollows. For example, in a case where a predetermined label isclick-selected, the selected label and a line drawing of a damage vectorcorresponding to the selected label are highlighted. The highlighting isperformed by a design change (coloring, dotted, thickening, brightnesschange, or the like) of the label and the line drawing of the damagevector. In a case where a dialog box for confirming whether to executean editing operation “delete” that can be performed for the damagevector is displayed near the selected label, and permission to execute“delete” is selected from the dialog box, “1” is assigned to the deleteoperation flag of the damage vector corresponding to the selected labeland the delete instruction input is completed.

FIG. 20 illustrates a manner in which the label of C1-3 is selected andthe delete instruction input is performed to a damage vectorcorresponding to the label. FIG. 21 illustrates an updated displayexample in which the display of the label of C1-3 is deleted, and thedisplay of the line drawing of the damage vector corresponding to thelabel of C1-3 is stopped as a result of performing the deleteinstruction input to the damage vector corresponding to the label ofC1-3. FIG. 22 is an example of an editing result of the hierarchicalstructure information in which “1” is assigned to the delete operationflag of the damage vector corresponding to the label of C1-3 as theresult of performing the delete instruction input. Even though thedelete instruction input is performed to the damage vector, thehierarchical structure information corresponding to the damage vector isnot deleted. This is for use in machine learning as described below.

(2) Adding or removing (partial addition or partial removal) a regioncomposing a damage vector with respect to the damage vectorcorresponding to a randomly selected label. In a case where the editinginstruction input is performed, “1” is assigned to the delete operationflag or the add operation flag corresponding to the selected label.Values of start point, end point, length, and width of the damage vectorrecorded in the hierarchical structure information are updatedcorresponding to an adding or removing region.

(3) Adding a damage vector that combines a plurality of discontinuousdamage vectors associated with a plurality of randomly selected labelsinto one continuous damage vector. In a case where the editinginstruction input is performed, “2” is respectively assigned to each addoperation flag of each combined damage vector.

An add instruction input of the damage vector can be performed asfollows. For example, in a case where two predetermined labels areclick-selected, the selected labels and line drawings of damage vectorscorresponding to the selected labels are highlighted, and a dialog boxfor confirming whether to execute an editing operation “combine” thatcan be performed for the corresponding damage vectors is displayed nearthe selected labels. In a case where permission to execute “combine” isselected from the dialog box, “2” is assigned to each add operation flagof each damage vector corresponding to the selected labels and the addinstruction input of the damage vector is completed.

FIG. 23 illustrates a manner in which labels of C1-5 and C8-1 areselected and the add instruction input of the damage vector thatcombines the damage vectors corresponding to the labels is performed.FIG. 24 illustrates an updated display example of a line drawing of anadded damage vector that combines the damage vectors corresponding tothe labels of C1-5 and C8-1 and a common label of “C1-5+C8-1” assignedto the damage vectors combined by the added damage vector as a result ofperforming the instruction input. In a case where the damage vectorscorresponding to the labels of C1-5 and C8-1 are combined in a straightline, the display of points P6 and P17 may be also deleted (notillustrated). FIG. 25 is an updated example of the hierarchicalstructure information in which “2” is assigned to the add operation flagof the damage vectors corresponding to the labels of C1-5 and C8-1. Thelabel of the combined damage vector may be anything that isdistinguishable from another damage vector. The vector group of thecombined damage vector may be the same as any vector group (for example,vector group to which long or short damage vector belongs) of thecombined damage vectors or another new vector group may be generated.This can be performed in the same manner as described in <Connection ofSeparated Damage Vectors>.

In the updated hierarchical structure information, the damage vector ofthe previously selected label C1-5 is set as the parent vector, and thedamage vector of the label C8-1 selected later is set as the childvector. In a case where the label C8-1 is previously selected, and thelabel C1-5 is selected later, the damage vector of the label C8-1 is setas the parent vector, and the damage vector of the label C1-5 is set asthe child vector. In any case, the plurality of damage vectors C1-5 andC8-1 in which “2” is assigned to the add operation flag and the addeddamage vector that combines with any one of the damage vectors C1-5 andC8-1 as the parent vector and with the other as the child vector arecollectively one continuous combined damage vector, and a new label“C1-5+C8-1” is assigned to the one continuous combined damage vector ina case where the damage vectors C1-5 and C8-1 and the added damagevector are combined in a straight line.

(4) Releasing the combination between the plurality of discontinuousdamage vectors associated with the plurality of labels. In a case wherethe release instruction input of the combination is performed, “0” isrespectively assigned to each add operation flag of each damage vectorin which the combination is released.

The release instruction input of the combination between the damagevectors can be performed as follows. For example, in a case where apredetermined label is selected from among the labels of the combineddamage vectors by above-described (3), the selected label and a linedrawing of a corresponding combined damage vector are highlighted, and adialog box for confirming whether to execute an editing operation“release combination” that can be performed for the correspondingcombined damage vectors is displayed near the selected label. In a casewhere permission to execute “release combination” is selected from thedialog box, each add operation flag of each damage vector combined bythe combined damage vector corresponding to the selected label ischanged from “2” to “0”, the relationship of the parent vector and thechild vector of each damage vector is deleted, and the combinationrelease instruction input of the damage vector is completed.

FIG. 26 illustrates a manner in which the label of “C1-5+C8-1”corresponding to the combined damage vector is selected, and the releaseinstruction input of the combination by the combined damage vectorcorresponding to the label. FIG. 27 illustrates a display example inwhich the combination between the damage vectors of labels of C1-5 andC8-1 is released as a result of performing the release instruction inputof the combination. FIG. 28 is an updated example of the hierarchicalstructure information in which “0” is assigned to the add operation flagof the damage vectors corresponding to the labels of C1-5 and C8-1. Thehierarchical structure information is updated such that the parentvector and child vector relationship between the damage vectors in whichthe combination is released is also deleted.

A label that can distinguish each damage vector after the combinationrelease may be newly assigned instead of reassigning the same label asthe label before being combined to each damage vector after thecombination release. In order to perform the machine learning thatcombination between specific damage vectors is wrong and the combinationis released manually, the same label as the label before being combinedmay be reassigned to each damage vector after the combination release.

A damage vector in which the combination is released is not limited tothe damage vector manually designated. For example, it is possible torelease the damage vector C5-2 that combines C3-1 and C4-1 by the methodof connecting the damage vectors as illustrated in FIG. 8. In the case,the vector groups C3 and C4 before the combination and the previouslabels C3-1 and C4-1 of the damage vectors that belong to the vectorgroups C3 and C4 are restored by selection of the label of the damagevector C5-2 and instruction of the combination release. In order torealize the above, the vector groups C3 and C4 and the labels C3-1 andC4-1 before executing the method of connecting the damage vectors arerequired to be recorded in the hierarchical structure information as ahistory before the connection.

(5) Display and selection of a label corresponding to a vector group,and deletion, combination, and release of the combination of the vectorgroup corresponding to the selected label. It can be performed in thesame manner as the display, selection, and the like of the labelcorresponding to individual damage vector.

As described above, according to the damage information processingdevice 100 and the method of processing damage information according tothe embodiment, it is possible to easily grasp the connectionrelationship between the damage vectors and to easily analyze and/orsearch the damage vector by the hierarchical structure information.

Since it is possible to delete, combine, and release the combination ofthe damage vector by selecting the label, it is possible to easily editthe hierarchical structure information even though a position of adamage vector having a complicated shape is not accurately designated.

The examples of the present invention are described, but the presentinvention is not limited to the embodiment and the modification exampledescribed above and can be variously modified without departing from thespirit of the present invention.

For example, steps S100 to S150 can be executed by the Prim's algorithmwhich is an algorithm of an optimization problem for obtaining minimumspanning tree of weighted connected graph by graph theory other than themethod described above.

That is, for example, it is assumed that a cost can be set betweenpixels of the detection result according to the idea of the graphtheory. It is assumed that the cost is a calculation result usingreference values such as direction, width, and distance of the damagevector (crack), and pixels with the smallest cost are connected. As aconcept of the cost calculation, a calculation method can be consideredsuch that the cost increases as the distance between the damage vectorsincreases, and the cost decreases as the direction between the damagevectors coincides with each other. In a case where the distance is far,but one crack-likeness is large by other references, it is possible toobtain a connection result reflecting the information. In a case wherethere are only pixels in the vicinity in which the cost between pixelsis sufficiently large, it is not necessary to connect the damage vectorsto each other. In a case where a shape may be bent at an unnatural angle(for example, acute angle of 90° or less) or an unnatural widthdifference may be generated (for example, step having width of five ormore pixels is generated between connected damage vectors) as a resultof the connection, a condition that does not connect the damage vectorsmay be set. In this manner, in a case where the distance between thedamage vectors is small, the angle therebetween is small, and the widthdifference therebetween is small for the difference in distance, angle,and width between the damage vectors, it is possible to set the cost soas to be small.

Alternatively, in the case of extracting the damage vector by the Prim'salgorithm, calculation reference values of the cost relating todistance, direction, and width of the damage vector may be changedaccording to the completion of the editing instruction input to correctextraction reference of the damage vector.

For example, in a case where delete operation flag “1” of the damagevector C5-2 is recorded by the delete operation to the damage vectorC5-2 of FIG. 8, threshold values of the angle α1 and the angle α2 arereduced by a predetermined amount (for example, 5°). Accordingly, thecost relating to the direction between the damage vectors to beconnected increases as an angle between the damage vectors is sharp.

Alternatively, as illustrated in FIG. 23, in a case where the directionbetween the damage vectors C1-5 and C8-1 belonging to different vectorgroups coincides with each other and the damage vectors are operated toconnect to each other, a threshold value of the distance connecting thedamage vectors in the same direction is increased by a predeterminedamount (for example, ten pixels). Accordingly, the cost relating to thedistance between the damage vectors in the same direction becomes small,and the damage vectors in the same direction are automatically connectedeasily even though the damage vectors are separated.

In addition, it is possible to extract one damage vector with highaccuracy by a combination of a part or all of various kinds of machinelearning such as the same neural network convergence calculation asJP2011-242365A, various methods such as the percolation method and theKruskal's algorithm disclosed in JP2015-195769, or various methods suchas the Prim's algorithm, the neural network convergence calculation, thepercolation method, or the Kruskal's algorithm, or by one or moreiterations of the combination of a part or all of the above.

EXPLANATION OF REFERENCES

-   -   1: bridge    -   2: floor slab    -   3: main girder    -   3A: joining part    -   100: damage information processing device    -   102: damage information acquisition unit    -   104: digital camera    -   106: image acquisition unit    -   108: image processing unit    -   110: damage vector generation unit    -   112: hierarchical structure information generation unit    -   114: damage vector extraction unit    -   116: hierarchical structure information recording unit    -   118: display unit    -   120: operation unit    -   S100: image input step    -   S110: damage extraction step    -   S120: damage vector generation step    -   S130: hierarchical structure information generation step    -   S140: display step    -   S150: recording step    -   S160: editing step

What is claimed is:
 1. A crack information editing device comprising: acrack information acquisition unit that acquires crack information on acrack of a structure detected by an image analysis of a surface image ofthe structure; a labeling unit that assigns a label for identifyingcrack information based on the crack information acquired by the crackinformation acquisition unit; a display unit that displays a video imageindicating the crack information on the surface image in an overlappedmanner and displays a video image indicating the label assigned by thelabeling unit in association with the video image indicating the crackinformation; a label selection unit capable of accepting selection of apredetermined label from among labels displayed by the display unit; anda crack information editing unit that accepts editing of crackinformation associated with the label for which the selection by thelabel selection unit is accepted, wherein the editing of the crackinformation accepted by the crack information editing unit includescombining a plurality of pieces of discontinuous crack informationassociated with a plurality of randomly selected labels into onecontinuous piece of crack information.
 2. The crack information editingdevice according to claim 1, wherein the display unit displays a videoimage indicating the label assigned by the labeling unit at a positionoutside the video image indicating the crack information.
 3. The crackinformation editing device according to claim 1, wherein the video imageindicating the label is a balloon individually including a label foreach of the crack information acquired by the crack informationacquisition unit or a list table including a plurality of labels of thecrack information acquired by the crack information acquisition unit. 4.The crack information editing device according to claim 1, wherein thedisplay unit highlights the video image of the crack informationassociated with the selected label.
 5. The crack information editingdevice according to claim 1, wherein the crack information acquisitionunit acquires the crack information on the crack of the structure by atleast one of Kruskal's algorithm, Prim's algorithm, neural networkconvergence calculation, or percolation method.
 6. The crack informationediting device according to claim 1, wherein the crack information isvector data including a width, a length, and a direction of a crack. 7.The crack information editing device according to claim 1, wherein thelabeling unit updates the label of the crack information acquired by thecrack information acquisition unit according to the editing of the crackinformation, and the display unit updates the video image indicating thecrack information and the video image indicating the label according tothe editing of the crack information.
 8. The crack information editingdevice according to claim 7, wherein in a case where a combinationbetween the plurality of pieces of crack information is accepted by thecrack information editing unit, the labeling unit assigns a common labelto the plurality of pieces of crack information for which thecombination is accepted, and the display unit displays a video imageindicating the common label in association with a video image indicatingthe combined plurality of pieces of crack information.
 9. The crackinformation editing device according to claim 7, wherein in a case whererelease of the combination between the plurality of pieces of crackinformation is accepted by the crack information editing unit, thelabeling unit assigns a label capable of distinguishing between theplurality of pieces of crack information for which the release of thecombination is accepted from each other to each of the plurality ofpieces of crack information, and the display unit displays each of thedistinguishable labels in association with a video image indicating eachof the plurality of pieces of crack information.
 10. A method of editingcrack information that is executed by a computer, the method comprising:acquiring crack information on a crack of a structure detected by animage analysis of a surface image of the structure; assigning a labelfor identifying crack information based on the acquired crackinformation; displaying a video image indicating the crack informationon the surface image in an overlapped manner and displaying a videoimage indicating the assigned label in association with the video imageindicating the crack information; accepting selection of a predeterminedlabel from among the displayed labels; and accepting editing of crackinformation associated with the label for which the selection isaccepted, wherein the editing of the crack information includescombining a plurality of pieces of discontinuous crack informationassociated with a plurality of randomly selected labels into onecontinuous piece of crack information.
 11. A non-transitory computerreadable tangible medium having a crack information editing program forcausing a computer to execute the method of editing crack informationaccording to claim 10.